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ABSTRACT 



An audio/video production system facilitates professional 
quality image manipulation and editing. A program input 
may be translated into any of a variety of graphics or 
television formats, including NTSC, PAL, SECAM and 
HDTV, and stored as data-compressed images, using any of 
several commercially available methods such as Motion 
JPEG, MPEG, etc. While being processed, the images may 
be re-sized to produce a desired aspect ratio or dimensions 
using conventional techniques such as pixel interpolation, 
and signals within the video data stream optionally may be 
utilized to control "pan/scan" operations at a receiving video 
display unit, in case this unit does not have the same aspect 
ratio as the source signal. Other information may be utilized 
to. restrict playback of the program material based on 
predetermined regional or geographical criteria. Frame rate 
conversion to and from conventional formats is performed 
by using the prevailing techniques employed for film-to- 
NTSC and film-to-PAL transfers, or by inter-frame 
interpolation, all well known in the art, or by reproduction 
of the program at a selected non-standard frame rate, option- 
ally combined with these prevailing techniques. By judi- 
cious selection of the optimal digitizing parameters, tiie 
system allows a user to establish an inter-related family of 
aspect ratios, resolutions, and frame rates, yet remain com- 
patible with currently available and planned graphics and 
television formats. 

27 Claims, 9 Drawing Sheets 
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MULTI-FORMAT AUDIOA^mEO 
PRODUCTION SYSTEM WITH FRAME- 
RATE CONVERSION 

FIELD OF THE INVENTION 

This invention relates generally to video production, 
photographic image processing, and computer graphics 
design, and, more particularly, to a multi-format video 
production system capable of professional quality editing 
and manipulation of images intended for television and otho^ 
applications, including HDTV programs. 

BACKGROUND OF THE INVENTION 

As die number of television channels available through 
various program delivery methods (cable TV, home video, 
broadcast, etc.) continues to proliferate, the demand for 
programming, particularly high-quality HDTV-format 
prograimning, presents special challenges, both technical 
and financial, to program producers. While the price of 
professional editing and image manipulation equipment 
continues to increase, due to the high cost of research and 
development and other factors, general-purpose hardware, 
including personal computers, can produce remarkable 
effects at a cost well within the reach of non-professionals, 
even novices. As a result, the distinction between these two 
classifications of equipment has become less well defined. 
Although general-purpose PC-based equipment may never 
allow professional-style rendering of images at fiill resolu- 
tion in real-time, each new generation of microprocessors 
enables progressively faster, higher-resolution applications. 
In addition, as the price of memory circuits and other data 
storage hardware continues to faU, the capacity of such 
devices has risen dramatically, thereby improving the pros- 
pects for enhancing PC-based image manipulation systems 
for such applications. 

In terms of dedicated equipment, attention has tradition- 
ally focused on the development of two kinds of profes- 
sional image-manipulation systems: those intended for the 
highest quality levels to support film effects, and those 
intended for television broadcast to provide "full 35 mm 
theatrical film quality," within the realities and economics of 
present broadcasting systems. Conventional thinking holds 
that 35 mm theatrical film quality as projected in theaters is 
equivalent to 1200 or more lines of resolution, whereas 
camera negatives present 2500 or more lines. As a result, 
image formats under consideration have been directed 
towards video systems having 2500 or more scan lines for 
high-level production, with hierarchies of production, 
HDTV broadcast, and NTSC and PAL compatible standards 
which are derived by down-converting these formats. Most 
proposals employ progressive scanning, although interlace 
is considered an acceptable alternative as part of an evolu- 
tionary process. Another important issue is adaptability to 
computer-graphics-compatible formats. 

Current technology directions in computers and image 
processing should allow production equipment based upon 
fewer than 1200 scan lines, with picture expansions to create 
a hierarchy of upward-converted formats for theatrical 
projection, film effects, and film recording. In addition, 
general-purpose hardware enhancements should be capable 
of addressing the economic aspects of production, a subject 
not considered in detail by any of the available references. 

SUMMARY OF THE INVENTION 

The present invention takes advantage of general-purpose 
hardware where possible to provide an economical multi- 
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format video production system. In the preferred 
embodiment, specialized graphics processing capabilities 
are included in a high-performance personal computer or 
workstation, enabling the user to edit and manipulate an 

5 input video program and produce an output version of the 
program in a final format which may have a different frame 
rate, pixel dimensions, or both. An internal production 
format is chosen which provides the greatest compatibility 
with existing and planned formats associated with standard 
and widescreen television, high-definition television, and 
film For compatibility with film, the frame rate of the 
internal production format is preferably 24 fps. Images are 
re-sized by the system to larger or smaller dimensions so as 
to fill the particular needs of individual applications, and 
frame rates are adapted by inter-frame interpolation or by 

^5 traditional schemes, including "3:2 pull-down" for 24-to-30 
fps conversions; simple speed-up (for 24-to-25 conversions) 
or slow-down (for 25-to-24 conversions) of playback-; or by 
manipulating the frame rate itself using a program storage 
facility with asynchronous reading and writing capabilities. 

20 The invention comprises a plurality of interface units, 
including a standard/widescreen interface unit operative to 
convert the video program in the input format into an output 
signal representative of a standard/widescreen formatted 
image, and output the signal to an attached display device. 

25 A high-definition television interface unit is operative to 
convert the video program in the input format into an output 
signal representative of an HDTV-formatted image, and 
output the signal to the display device. A centralized con- 
troller in operative communication with the video program 

30 input, the graphics processor, and an operator interface, 
enables conmiands entered by an operator to cause the 
graphics processor to perform one or more of the conver- 
sions using the television interfaces. The present invention 
thus encourages production at relatively low pixel dimen- 

35 sions to make use of lower-cost general-purpose hardware 
and to maintain high signal-to-noise, then subsequentiy 
expands the result into a higher-format final program This 
is in contrast to competing approaches, which recommend 
operating at higher resolution, then down- sizing, if 

40 necessary, to less expensive formats, which has led to the 
expensive dedicated hardware, the need for which the 
present invention seeks to eliminate. In addition, the flexible 
storage and playback facilities allow extensive control of tiie 
playback of the program material, enabling frame rate 

45 adjustments and alterations, and providing for time-shifting 
of the start and end points of the program reproduction in 
those cases wherein direct control of the source material 
frame rate is not practical, due to physical separation of the 
equipment or multiple reception points simultaneously pro- 
se dudng outputs at different frame rates from the same source 
signal playback data stream. In commercial 
implementations, the invention readily accepts and pro- 
cesses enhanced information, such as pan/scan information 
or identification information to restrict viewing based on 

55 regional or geographical marketing plans. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIGS. lA-lD show the preferred and alternative image 
aspect ratios in pixels; 
60 FIG. 2 shows a functional diagram for disk-based video 
recording; 

FIG. 3 shows the components comprising the multi- 
format audioMdeo production system; 

FIG. 4 is a block diagram of an alternative embodiment of 
65 video program storage means incorporating asynchronous 
reading and writing capabilities to carry out frame-rate 
conversions; 
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FIG. 5 shows the inter-relationship of the multi-format efit from the implementation of this system. In terms of 

audio/video production system to many of the various audio, the data rate requirements are largely a function of 

existing and planned video formats; sound quality. The audio signals may be handled separately, 

, . .1. • I * *• f « 1 * * 1 • • as in an "interlocked" or synchronized system for 

HG. 6 shows the m^lementation of a complete television ^^^^^^^ J be interleaved within the 

production system, mcludmg signals provided by broadcast 5 P ^^^^ ^^^^^ y^^^^^ ^ 

sources, satellite receivers, and data-network interfaces; production manipulations desired, and by the limi- 

FIG. 7 shows the preferred methods for conversion tations of the current technology, 

between several of the most common frame-rate choices; Although a wide variety of video formats and apparatus 

JO configurations are applicable to the present invention, the 

FIG. 8 shows a block diagram of an embodiment of a system will be described in terms of the alternatives most 

universal playback device for multi-format use. compatible with currentiy available equipment and methods. 

FIG. lA iDustrates one example of a compatible system of 

DETAILED DESCRIPTION OF THE ^-^^ ^^^^ ^^^y dimensions. The selected frame rate is 

PREFERRED EMBODIMENT preferably 24 per second (2:1 interlaced), for compatibility 

The present invention is primarily concerned with the with film elements; the selected picture dimension in pixels 
conversion of disparate graphics or television formats, is preferably 1024x576 (0.5625 Mpxl), for compatibility 
including requisite frame-rate conversions, to establish an with the 16:9 'Svide-screen" aspect ratio anticipated for 
inter-related family of aspect ratios, resolutions, and frame HDTV systems, and the conventional 4:3 aspect ratio used 
rates, while remaining conq)atible with available and future 20 for systems [768x576 (0.421875 Mpxl)]. All imple- 
graphics/TV formats. These formats include images of pixel mentations preferably rely on square pixels, though other 
dimensions capable of being displayed on currentiy avail- pixel shapes may be used. Re-sizing (using tiie well known, 
able multi-scan conq)uter monitors, and custom hardware sophisticated sampling techniques available in many image- 
will be described whereby frames of higher pixel-count manipulation software packages or, alternatively, using 
beyond the capabilities of these monitors may be viewed. 25 hardware circuitry described herein below) to 2048x1152 
Images are re-sized by the system to larger or smaller (2.25 Mpxl) provides an image suitable for HDTV displays 
dimensions so as to fill the particular needs of individual or even theatrical projection systems, and a further re-sizing 
appUcations, and frame rates are adapted by inter-frame to 4096x2304 (9.0 Mpxl) is appropriate for even the most 
interpolation or by traditional schemes such as using "3:2 demanding production effects. Images may be data com- 
puU-down" (for 24 to 30 frame-per-second film-to-NTSC 30 pressed 5:1 for 16:9 '^vide- screen" TV frames, or 10:1 for 
conversions) or by speeding up the frame rate itself (as for HDTV; the data files may tiien be stored on conventional 
24 to 25 f^s for PAL television display). The re-sizing disk drives, requiring only approximately 8.1 MB/sec for 
operations may involve preservation of tiie image aspect wide-screen frames in RGB, and only 16.1 MB/sec for 
ratio, or may change the aspect ratio by "cropping" certain HDTV frames in RGB. 

areas, by performing non-linear tran^ormations, such as 35 An alternative embodiment of the invention is shown in 

"squeezing" the picture, or by changing the vision center for FIG. IB. In this case, the user would follow a technique 

'Spanning," "scanning" and so forth. Inasmuch as film is commonly used in film production, in which the film is 

often referred to as "the universal format," (primarily exposed as a 4:3 aspect ratio image. When projected as a 

because 35 -mm film equipment is standardized and used wide-screen format image, the upper and lower areas of the 

throughout the world), the preferred internal or "production" 40 frame may be blocked by an aperture plate, so that the image 

frame rate is preferably 24 fjps. This selection also has an shows the desired aspect ratio (typically 1.85:1 or 1.66:1). If 

additional benefit, in that the 24 fps rate allows the imple- the original image format were recorded at 24 frames per 

mentation of cameras having greater sensitivity than at 30 second, with a 4:3 ratio and with a dimension in pbcels of 

fps, which is even more critical in systems using progressive 1024x768, all image manipulations would preserve these 

scanning (for which the rate will be 48 fields per second vs. 45 dimensions. Complete con^)atibility with tiie existing for- 

60 fields per second in some other proposed systems). mats would result, with NTSC and PAL images produced 

The image dimensions chosen allow the use of conven- directly from these images by re-scaling, and tiie aforemen- 

tional CCD-type cameras, but the use of digital processing tioned wide-saeen images would be provided by excluding 

directiy tiirough die entire signal chain is preferred, and tiiis 96 rows of pixels from die top of tiie image and 96 rows of 

is implemented by replacing the typical analog RGB pro- 50 pixels from the bottom of tiie image, resulting in tiie 

cessing circuitry with fully digital circuitry. Production 1024x576 image size as disclosed above. The data content 

effects may be conducted in whatever image size is of each of tiiese frames would be 0.75 Mpxls, and die data 

appropriate, and tiien re-sized for recording. Images are storage requirements disclosed above would be affected 

recorded by writing the digital data to storage devices accordingly. 

employing removable hard-disk drives, disk drives witii 55 Another embodiment of the invention is depicted in FIG. 

removable media, optical or magneto-optical based drives, IC. In this alternative, the system would follow tiie image 

tape-baseddrives.or semiconductor-based memory devices, dimensions suggested in several proposed digital HDTV 

preferably in compressed-data form. As data rates for image formats under consideration by tiie Advanced Television 

processing and reading-from- or writing-to- disk drives Study Committee of the Federal Communications Commis- 

increase, many processes tiiat currentiy require several sec- 60 sion. The format to be adopted is expected to assume a 

onds will soon become attainable in real-time; this will wide-screen image having dimensions of 1280x720 pixels, 

eliminate the need to record fihn or video frames at slower Using these image dimensions (but at 24 fps with 2:1 

rates. Other production effects, such as slow-motion or interlace), compatibility with the existing formats would be 

fast-motion may be incorporated, and it is only the frame- available, with NTSC and PAL images derived from this 

processing-rate of these effects that is limited in any way by 65 frame size by excluding 160 colunms of pixels from each 

the technology of the day. In particular, techniques such as side of the image, thereby resulting in an image having a 

non-linear-editing, animation, and special-effects will ben- dimension in pixels of 960x720. This new image would then 
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be re-scaled to produce images having pixel dimensions of re-sizing, the improved signal-to-noise ratio is retained. In 

640x480 for NTSC. or 768x576 for PAL; the corresponding the practical implementation of cameras conforming to this 

wide-screen formats would be 854x480 and 1024x576, new design approach, there will be less of a need for 

respectively. In this case, an image having a dimension in extensive lighting provisions, which in turn, means less 

pixels of 1280x720 would contain 0.87890625 Mpxl, with 5 demand upon the power generators in remote productions, 

1,000 TV lines of resolution; furthermore, the systems under and for AC-power in studio applications, 

evaluation by the ATSC of the FCC also assume a decima- In CCD-based cameras, it is also a common technique to 

tion of the two chrominance signals, with detail of only increase the apparent resolution by mounting the red and 

640x360 pixels retained. The data storage requirements blue CCD-elements in registration, but offsetting the green 

disclosed above would be affected accordingly. The devel- jq CCD-element by one-half pixel width horizontally. In this 

opment path to 24 fps with progressive scanning is both case, picture information is in-phase, but spurious informa- 

well-defined and practical, as is the use of the previously tion due to aliasing is out-of-phase. When the three color 

described methods to produce images having a dimension in signals are mixed, the picture information is intact, but most 

pixels of 2048x1152. of the alias information will be canceled out. This technique 

A further alternative embodiment of the invention is 15 will evidently be less effective when objects are of solid 

shown in FIG. ID. As with the system described with colors, so it is still the usual practice to include low-pass 

reference to FIG. IB, the user follows the technique com- optical filters mounted on each CCD-element to suppress the 

monly used in film production, wherein the film is exposed alias information. In addition, this technique cannot be 

as a 4:3 aspect ratio image. When projected as a wide-screen applied to computer-based graphics, in which the pixel 

format image, the upper and lower areas of the frame area 20 images for each color are always in registration. However, in 

again blocked by an aperture plate, so that the image shows general-use video, the result of the application of this 

the desired aspect ratio (typically 1.85:1 or 1.66:1). For an spatial- shift offset is to raise the apparent Luminance (Y) 

original image format recorded at 24 frames per second, horizontal resolution to approximately 800 television lines, 

with 4:3 ratio and with pixel dimensions of 1280x960, all The availability of hard-disk drives of progressively 

image manipulations preserve these dimensions. Complete 25 higher capacity and data transmission rates is allowing 

compatibility with the existing formats results, with NTSC successively longer program duration and higher resolution 

and EAL images produced directly from these images by image displays in real-time. At the previously cited data 

resealing, and the aforementioned wide-screen images are rates, wide-screen frames would require 486 MB/min, so 

provided by excluding 120 rows of pixels from the top of the that currently available 10 GB disk drives will store more 

image and 120 rows of pixels from the bottom of the image, 30 than 21 minutes of video. When the anticipated 100 GB disk 

thereby resulting in the 1280x720 image size as described drives (2,5-inch or 3. 5 -inch disks using Co — Q, barium 

above. The data content of each of these frames is ferrite, or other high-density recording magnetic materials) 

0.87890625 Mpxls, and the data storage requirements dis- become available, these units will store 210 minutes, or 3 Vi 

closed above are affected accordingly. hours of video. For this application, a data storage unit is 

In each of the cases described herein above, a positioning 35 provided to facilitate editing and production activities, and 
or image centering signal may be included within the data it is anticipated that these units would be employed in much 
stream, so as to aUow the inclusion of information which the same way as video cassettes are currently used in 
may be utilized by the receiving unit or display monitor to Betacam and other electronic news gathering (^G) cam- 
perform a "pan/scan" operation, and thereby to optimize the eras and in video productions. This data storage unit may be 
display of a signal having a different aspect ratio than that of 40 implemented by use of a magnetic, optical, or magneto- 
the display unit. For example, a program transmitted in a optical disk drive with removable storage media, by a 
wide-screen forma would include information indicating the removable disk-drive unit, such as those based on the 
changingpositionof the image center, so that a conventional PCMCIA standards, or by semiconductor-based memory. 
(4:3 aspect ratio) display unit would automatically pan to the Although PCMCIA media are 1.8-inches in dimension, 
proper location. For the display of the credits or special 45 alternative removable media storage units are not restricted 
panoramic views, the monitor optionally could be switched to this limit, and could employ larger media, such as 2.5-inch 
to a full "letter-box" display, or the image could be centered or 3.5-inch disks; this, in turn, will lead to longer duration 
and rescaled to include information corresponding to an program data storage, or alternatively this storage capacity 
intermediate situation, such as halfway between full-height could be applied to lower ratios of data compression or 
(with cropped sides) and letter-box (full-width, but with 50 higher-pixel-count images, within the limits of the same size 
blank spaces above and below the image on the display). media. 

This positioning/rescaling information would be determined FIG. 2 shows the functional diagram for the storage- 

under operator control (as is typical for pan/scan operations device-based digital recorder employed in the video camera, 

when performing film transfers to video) so as to maintain or separately in editing and production facilities. As shown, 

the artistic values of the original material, within the limi- 55 a removable hard disk drive 70 is interfaced through a bus 

tations of the intended display format controller 72; in practice, alternative methods of storage 

Conventional CCD-element cameras produce images of such as optical or magneto-optical drives could be used, 

over 800 TV Lines horizontal Luminance (Y) resolution, based on various interface bus standards such as SCSI-2 or 

with a sensitivity of 2,000 lux at f8, and with a signal-to- PCMCIA. This disk drive system currently achieves data 

noise ratio of 62 dB. However, typical HDTV cameras, at 60 transfer rates of 20 MB/sec, and higher rates on these or 

1,000 TV Lines resolution and with similar sensitivity, other data storage devices, such as high-capacity removable 

produce an image with only a 54 dB signal-to-noise ratio, memory modules, is anticipated. The microprocessor 74 

due to the constraints of the wideband analog amplifiers and controls the 64-bit or wider data bus 80, which integrates the 

the smaller physical size of the CCD-pixel-elements. By various components. Currendy available microprocessors 

employing the more conventional CCD-elements in the 65 include the Alpha 21064 by Digital Equipment Corporation, 

camera systems of this invention, and by relying upon the or the MIPS R4400 by MIPS Technologies, Inc.; future 

computer to create the HDTV-type image by image implementations would rely on the P6 by Intel Corp. or the 
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PowerPC 620. which is capable of sustained data transfer 
rates of 100 MB/sec. Up to 256 MB of ROM. shown at 76, 
is anticipated for operation, as is 256 MB or more of RAM. 
shown at 78. Current PC-based video production systems 
are equipped with at least 64 MB of RAM. to allow 
sophisticated editing effects. The graphics processor 82 
represents dedicated hardware that performs the various 
manipulations required to process the input video signals 84 
and the output video signals 86; although shown using an 
RGB format, either the inputs or outputs could be configured 
in alternative signal formats, such as Y/R-Y/B- Y. YIQ, YUV 
or other commonly used alternatives. In particular, while a 
software-based implementation of the processor 82 is 
possible, a hardware-based implementation is preferred, 
with the system employing a compression ratio of 5: 1 for the 
conventional/widescreen signals ("NTSC/PAL/ 
Widescreen"), and a 10:1 compression ratio for HDTV 
signals (2048x1152, as described herein above). An example 
of one of the many available options for this data compres- 
sion is the currently available Motion- JPEG system. Image 
re- sizing alternatively may be performed by dedicated 
microprocessors, such as the gm865Xl or gm833X3 by 
Genesis Microchip, Inc. Audio signals may be included 
within the data stream, as proposed in the several systems 
for digital television transmission already under evaluation 
by the Federal Communications Commission, or by one of 
the methods available for integrating audio and video signals 
used in multi-media recording schemes, such as the 
Microsoft **AVr' ( AudioAldeo Interleave) file format. As an 
alternative, an independent system for recording audio sig- 
nals may be implemented, either by employing separate 
digital recording provisions controlled by the same system 
and electronics, or by implementing completely separate 
equipment external to the camera system described herein 
above. 

FIG. 3 shows the components that comprise a multi- 
format audioMdeo production system As in the case of the 
con^)uta' disk-based recording system of FIG. 2, an inter- 
face bus controller 106 provides access to a variety of 
storage devices, preferably including an internal hard-disk 
drive 100, a tape-back-up drive 102, and a hard-disk drive 
with removable media or a removable hard-disk drive 104; 
other possible forms of high-capacity data storage (not 
shown) utilizing optical, magneto-optical, or magnetic stor- 
age techniques may be included, as appropriate for the 
particular application. The interface bus standards imple- 
mented could include, among others, SCSI-2 or PCMCIA. 
Data is transmitted to and from these devices under control 
of microprocessor 110. Currently, data bus 108 would oper- 
ate as shown as 64-bits wide, employing microprocessors 
such as those suggested for the computer-disk-based video 
recorder of FIG. 3; as higher-powered microprocessors 
become available, such as the PowerPC 620. the data bus 
may be widened to accommodate 128 bits, and the use of 
multiple parallel processors may be employed, with the 
anticipated goal of 1,000 MIPS per processor. Up to 256 MB 
of ROM 112 is anticipated to support the requisite software, 
and at least 1.024 MB of RAM 114 will allow for the 
sophisticated image manipulations, inter-frame 
interpolation, and intra-frame interpolation necessary for 
sophisticated production effects, and for conversions 
between the various image formats. 

A key aspect of the system is the versatility of the graphics 
processor shown generally as 116. Eventually, dedicated 
hardware will allow the best performance for such opera- 
tions as image manipulations and re- scaling, but it is not a 
requirement of the system that it assume these functions. 
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Three separate sections are employed to process the three 
classifications of signals. Although the video input and 
output signals described herein below are shown, by 
example, as RGB, any alternative format for video signals. 

5 such as Y/R-Y/B-Y, YIQ. YUV. or other alternatives may be 
employed as part of the preferred embodiment. One possible 
physical implementation would be to create a separate 
circuit board for each of the sections as described below, and 
manufacture these boards so as to be compatible with 

jQ existing or future PC-based electrical and physical intercon- 
nect standards. 

A standard/widescreen video interface 120, intended to 
operate within the 1024x576 or 1024x768 image sizes, 
accepts digital RGB signals for processing and produces 

15 digital RGB outputs in these formats, as shown generally at 
122. Conventional internal circuitry comprising D/A con- 
verters and associated analog amplifiers are employed to 
convert the internal images to a second set of outputs, 
including analog RGB signals and composite video signals. 

20 These outputs may optionally be supplied to either a con- 
ventional multi-scan computer video monitor or a conven- 
tional video monitor having input provisions for RGB 
signals (not shown). A third set of outputs supplies analog 
Y/C video signals. The graphics processor may be config- 

25 ured to accept or output these signals in the standard NTSC, 
PAL, or SECAM formats, and may additionally be utilized 
in other formats as employed in medical imaging or other 
specialized applications, or for any desired format for com- 
puter graphics ^plications. Conversion of these 24 frame- 

30 per-second images to the 30 ^s (actuaUy, 29.97 fps) NTSC 
and 25 fps PAL formats may be performed in a similar 
manner to that used for scaimed film materials, that is, to 
NTSC by using the conventional 3:2 '*pull-down" field- 
sequence, or to PAL by reproducing the images at the higher 

35 25 fjps rate. For other HDTV frame rates, aspect ratios, and 
line rates, intra-frame and inter-frame interpolation and 
image conversions may be performed by employing com- 
parable techniques well known in the art of computer 
graphics and television. 

40 An HDTV video interface 124, intended to operate within 
the 2048x1152 or 2048x1536 image sizes (with re-sizing as 
necessary), accepts digital RGB (or alternative) signals for 
processing and produces digital outputs in the same image 
format, as shown generally at 126. As is the case for the 

45 Standard/Widescreen interface 120. conventional internal 
circuitry comprising D/A converters and associated analog 
amplifiers are employed to convat the internal images to a 
second set of ou^uts. for analog RGB signals and composite 
video signals. 

50 The third section of the graphics processor 116 shown in 
FIG. 3 is the film output video interface 128, which com- 
prises a special set of video outputs 130 intended for use 
with devices such as laser film recorders. These outputs are 
preferably configured to provide a 4096x2304 or 4096x 

55 30.72 image size from the image sizes employed internally, 
using re- sizing techniques discussed herein as necessary for 
the format conversions. Although 24 fps is the standard 
frame rate for film, some productions employ 30 fps 
(especially when used with NTSC materials) or 25 fps 

60 (especially when used with PAL materials), and these alter- 
native frame rates, as well as alternative image sizes and 
aspect ratios for internal and output formats, are anticipated 
as suitable applications of the invention, with "3:2-pull- 
down" utilized to convert the internal 24 fps program 

65 materials to 30 fps, and 25 fps occurring automaticaUy as the 
film projector runs the 24 fps films at the 25 fps rate utilized 
for PAL-type materials. 
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Several additional features of this system are disclosed in storage means 412 and 414 may be used in alternating 

FIG. 3. The graphics processor includes a special output 132 fashion, with one storing the source signal until it reaches its 

for use with a color printer. In order to produce the highest full capacity. At this point, the other storage means would 

quality prints from the screen display it is necessary to adjust continue storing the program signal until it, too, reached its 

the print resolution to match the image resolution, and this 5 full capacity. The maximum program storage capacity for 

is automatically optimized by the graphics processor for the the program signals will be determined by various factors, 

various image sizes produced by the system. In addition, such as the input program signal frame rate, the frame 

provisions are included for an image scanner 134, which dimensions in pixels, the data compression rate, the total 

may be implemented as a still image scanner or a film number and capacities of the various storage means, and so 

scanner, thereby enabling optical images to be integrated forth. When the available storage capacity has been filled, 

into the system. An optional audio processor 136 includes this data storage scheme automatically will result in 

provisions for accepting audio signals in either analog or previously-recorded signals being overwritten; as additional 

digital form, and outputting signals in either analog or digital storage means are added, the capacity for time-delay and 

form, as shown in the area generally designated as 138. For frame rate conversion is increased, and there is no require- 

materials including audio intermixed with the video signals ^5 ment that all storage means be of the same type, or of the 

as described herein above, these signals are routed to the same capacity. In practice, the storage means would be 

audio processor for editing effects and to p-ovide an inter- implemented using any of the commonly available storage 

face to other equipment. techniques, including, for example, magnetic disks, optical 

It is important to note that although FIG. 3 shows only one or magneto-optical discs, or semiconductor memory, 

set of each type of signal inputs, the system is capable of 20 When it is desired to begin playback of the program 

handling signals simultaneously from a plurality of sources signal, signal processor 416, under management by control- 

and in a variety of formats. Depending on the performance ler 418 and through user interface 420, retrieves the stored 

level desired and the image sizes and frame rates of the program signals from the various storage means provided, 

signals, the system may be implemented with multiple hard and performs any signal conversions required. For example, 

disk or other mass-storage units and bus controUers, and 25 if the input program signals were provided at a 25 fps rate 

multiple graphics processors, thereby allowing integration (corresponding to a 625-line broadcast system), the signal 

of any combination of live camera signals, prerecorded processor would perform image resizing and inter-frame 

materials, and scanned images. Improved data compression interpolation to convert the signal to 30 ^s (corresponding 

schemes and advances in hardware speed will allow pro- to a 525-line broadcast system). Other conversions (such as 

gressively higher frame rates and image sizes to be manipu- 30 color encoding system conversion from PAL-format to 

lated in real-time. NTSC, etc., or frame dimension or aspect-ratio conversion) 

Simple playback of signals to produce PAL output is not will be performed as necessary. The output of the signal 

a serious problem, since any stored video images may be processor is then available in digital form as 422, or may be 

replayed at any frame rate desired, and filmed material processed further, into analog form 426 by D/A converts 

displayed at 25 fps is not objectionable. Indeed, this is the 35 424. In practice, a separate data bus (not shown) may be 

standard method for performing fUm-to-tape transfers used provided for output signals, and/or the storage means may be 

in PAL- and SECAM-television countries. Simultaneous implemented by way of dual-access technology, such as 

output of both NTSC and film-rate images may be per- dual-port RAM utilized for video-display applications, or 

formed by exploiting the 3:2 field-interleaving approach: multiple-head-access disk or disc storage units, which may 

5x24=120=2x60; that is, two film frames are spread over 40 be configured to provide simultaneous random-access read 

five video fields. This makes it possible to concurrently and write capabilities. Where single-head storage means are 

produce film images at 24 fps and video images at 30 fjps. inq>lemented, suitable input buffer and output buffer provi- 

The difference between 30 fps and the exact 29.97 fps rate sions are included, to allow time for physical repositioning 

of NTSC may be palliated by slightly modifying the system of the record/play head. 

frame rate to 23.976 ^s. This is not noticeable in normal 45 In utilizing program storage means including synchro- 

fUm projection, and is an acceptable deviation from the nous recording and reprogram capabilities of the types just 

normal film rate. described, if it is known that a program will be stored in its 

The management of 25 fps (PAI^type) output signals in entirety before the commencement of playback, that is, with 

a system configured for 24 ^s production applications (or no time-overly existing between the occurrence of the input 

vice versa) presents technical issues which must be 50 and output signal streams, it typically will be most efficient 

addressed, however. One alternative for facilitating these to perform any desired frame conversion on the program 

and other frame-rate conversions is explained with reference either before or after initial storage, depending upon which 

to FIG. 4. A digital program signal 404 is provided to a stored format would result in the least amount of required 

signal compression circuit 408; if the input program signal memory. For example, if the program is input at a rate of 24 

is provided in analog form 402, then it is first processed by 55 frames per second, it probably will be most efficient to 

A/D converter 406 to be placed in digital form. The signal receive such a program and store it at that rate, and perform 

compressor 408 processes the input program signal so as to a conversion to higher frame rates upon output. In addition, 

reduce the effective data rate, utilizing any of the commonly in situations where a program is recorded in its entirety prior 

implemented data compression schemes, such as motion- to conversion into a particular output format, it is most 

JPEG, MPEG-1, MPEG-2, etc. well known in the art As an 60 efficient to store the program either on a tape-based format 

alternative, the digital program signal 404 may be provided or a format such as the new high-capacity DVD discs, given 

in data-con^jressed form. At this point, the digital program the reduced cost, on a per-bit basis, of these types of storage, 

signal is provided to data bus 410. By way of example. Of course, conventional high-capacity disk storage also may 

several high-c^adty digital storage units, designated as be used, and may become more practical as storage capaci- 

"storage means A" 412 and "storage means B" 414, are 65 ties continue to increase and costs decrease. If it is known 

included for storing the digital program signals presented on that a program is to be output at a different frame rate while 

data bus 410, under management by controDer 418. The two it is being input or stored, it is most preferable to use disk 
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Storage and to perform the frame rate conversion on an 16.2 MB/sec (for 24 fps HDTV RGB-based formats, using 

ongoing basis, using one of the techniques described above. 10:1 data compression such as MPEG or motion- JPEG), it 

In this case, the high-capacity video storage means, in effect, may be necessary to store as much as 4.7 GBytes of data, 

assumes the role of a large video buffer providing the fastest which is readily available by way of multiple disks or discs 

practical access time. Again, other memory means (types) 5 utilizing conventional storage technology. In practice, the 

may be used, including all solid-state and semiconductor transmission simply would begin 300 seconds before the 

types, depending upon economic considerations, and so playback begins, and once the playback starts, the amount of 

fojXh. buffered signal would decrease by one frame per second of 

As an example of an alternative embodiment, the storage playback until the last signal is passed through as soon as it 

means 100 or 104 of the multi-format audio/video produc- 10 received. 

tion system would be equipped with dual-head playback A minor of this situation arises in the case of a 25 fjps 

facilities and a second set of graphics processing hardware signal to be displayed at 24 fps, or some other data rate 

(not shown) analogous in function to the normal graphics readUy provided by conversion from 24 fps (such as 30 fjps). 

processing hardware (identical to the standard hardware ^ this case, the source signal is provided at a higher frame 

shown as 120, 124, and 128), and having analogous signal 15 rate than the output signal, so that a viewer watching a 

output facilities (identical to the standard provisions shown program from the onset of the transmission would fall 

as 122, 126, 130, and 132). In this case, the two heads would behind the source signal rate, and the storage means would 

be driven independently, to provide simultaneous, asynchro- t»e required to hold frames of the program to be displayed at 

nous playback at different frame rates; that is, one head a time after the source signal arrival time; in the case of the 

would be manipulated so as to provide a data stream 20 ^^O minute program described above, the viewing of the 

coiresponding to a first frame rate (for example, 25 fps), source program would conclude 300 seconds after the 

while the second head would be manipulated so as to source signal itseff had concluded, and comparable calcu- 

provide a data stream corresponding to a second frame rate lations are appUed for the storage means. In this case, the 

(for example, 24 fps, which, in turn, may be converted to 30 extra frames would be accumulated as the buffer contents 

fps, using the "3:2-pull-down" technique). Evidently, both 25 increased, untQ, after the transmission has completed, the 

the storage means and also the internal bus structure of the iast 300 seconds would be replayed directly from the storage 

system would have to support the significantly increased means. 

data rate for providing both signal streams simultaneously. The conversion of frame rates from 30 fps to 24 fps or to 
or, as an alternative, a second, separate data bus would be 25 fps is more complicated, because some form of inter- 
provided. 30 frame interpolation is required In one case, a multi-frame 
In some applications, a more sophisticated conversion storage faciUty would aUow this type of interpolation to be 
scheme is required. For example, in frame rate conversion performed in a relatively conventional manner, as typicaUy 
systems of conventional design, if an input program signal is utilized in NTSC-to-PAL conversions (30 ^ps to 25 ^ps). 
having a 24 fps rate format is to be displayed at a 25 fps rate. At this point, a 25 fps to 24 fps conversion could be 
it is customary to simply speed up the source signal 35 performed, in accordance with the methods and apparatus 
playback, so as to provide the signals at a 25 ^s rate. This described herein above. 

is the procedure utilized for performing a conversion of K should be noted that if, for example, a DVD-R-type of 

24-fps-film-material for 25 fps PAL-format video usage. storage media is selected, then the implementation of the 

However, implementation of tfiis method requires that the significantly higher data compression rates of MPEG-2 

user of the output signal must have control over the source- 40 coding techniques will result in the ability to record an entire 

signal playback In a wide-area distribution system (such as program of 120 minutes or more in duration. In this manner, 

direct-broadcast-satellite distribution) this is not possible. the complete program is held in the disc/buffer, thereby 

While a source signal distributed at 24 fps readily could be enabling the user to perform true time-shifting of the 

converted to 30 fps (utilizing the familiar "3-2-pull-down" program, or allowing the program rights owner to accom- 

technique), the conversion to 25 fps is not as easily 45 plish one form of software distribution, in accordance witii 

performed, due to the complexity and expense of processing the invention. 

circuitry required for inter-frame interpolation over a An alternative method to carry out this frame rate con- 

24-frame sequence. However, utilizing the system disclosed version is to perform, in effect, the reverse of the "3:2 

in FIG. 4, the conversion is straightforward. If, for example, puU-down" procedure. If one were to select every fifth field 

a 24 fps program lasting 120 minutes is transmitted in this 50 and delete it from the signal sequence, the resultant ratio of 

format, there are a total of 172,800 frames of information 5:4 of the remaining fields would result in the desired 

(24 frames/secondx60 seconds/minutexl20 minutes); dis- conversion of 30 fps to 24 fps. In this case, it is necessary 

play of this program in speeded-up fashion at 25 fjps would to re-interlace the image signal, by reversing the field 

mean that the input frame rate falls behind the output frame identity (i.e., from odd to even, or from even to odd) of each 

rate by one frame per second, or a total of 7,200 frames 55 of the four following fields, so that the signal stream 

during the course of the program. At a 24 fps transmission continues to alternate between odd and even fields. The next 

rate, this corresponds to 300 seconds transmission time; in four fields would be retained, then the fifth field deleted, and 

other words, for the input program (at 24 fjps) and the output the next four again would have their field identity reversed, 

program (at 25 fjps) to end together, the input process would This pattern would be continued throughout the program. If 

have to commence 300 seconds before the output process 60 the original source material were from 24 ^s (for example, 

begins. In order to perform this process, then, it is necessary film), then if the repeated fields (i.e., the '*3" field of the 3:2 

for the storage means to have the capacity to retain 300 sequence) were identified at the time of conversion; dien the 

seconds of program material, in effect serving as a signal removal of these fields would simply return the material to 

buffer. As an example, for the systems disclosed herein (in its original form. If the desired conversion is to be from 30 

which the compressed-data rates range from 8.1 MB/sec (for 65 fps to 25 fps, then an equivalent procedure would be 

24 fps standardAvidescreen RGB-based TV formats, using performed using the storage-based frame-conversion 

5:1 data compression such as MPEG or motion-JPEG) to method described herein above, or, alternatively, every sixth 
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field could be deleted, in accordance with the method up to 64 Mb of ROM 232. This microprocessor could be 

described for 30 fps to 24 ^s. Depending on the original implemented using one of the units previously described 

source material fi-ame rate and intermediate conversions, the such as the PowerPC 604 or PowerPC 620. A hard disk drive 

user would select the method likely to present the least controUer 234 provides access to various storage means, 
amount of image impairment. 5 including, for example, an internal hard disk drive unit 236. 

T *u • u- u V oui^ a removable hard disk drive unit 238, or a tape drive 240; 

In the case in which the user is able to exercise control , ^ . , . i .t. r^y^ . ^- • ^ 

^, ^ , ^ o*^„-^i these storage umts also enable the PC to function as a video 

over the frame rate of the source program matenal, an j ^.t^jt. * l- ^a'^ 

alternative method is available. Just as lilm-to-video trans- '^'^^^^ A graphic processor 242. 

fers for PAL-format (25 fps) presentations utilize a speeded- comprising dedicated hardware which opUonaUy be mq)le- 
upplaybackofthe24fpsfUinniateiialstosoiircethematthe 10 rented as a separate plug-in circuit board, performs the 

r. . xi.- xu-^jj image mampulations required to convert between the van- 

25 fps rate (thereby matchmg the mtended output frame ^ mouxp u^u v^t^^v 

* \ *u J: ^„oKi^. ^ ..o^^ ous frame sizes (in pixels), aspect raUos, and frame rates, 

rate), the reverse of this process enables a user to utilize ^ *^ ^T^n ax* 

/ . , . . , . * oc L * I. This graphics processor uses 16 to 32 MB of DRAM, and 2 

materials ongmated at 25 fps to produce playback at 24 ips. ^ o ^Vr. ^ ^ ttT a ^ * j j- *t- i * * 

A J- I A • u • fo^^u I. to 8 MB of VRAM, dependmg on the type of display output 

As disclosed herem above, conversions of 24 ^s matenals . . j • * loon -70 a ^* 

u ^1^^ ;„ ^^«,.^«t;^noi ^^tK^Hc ^c..^i, ae th*. 15 desired For frame size of 1280x720 with an aspect ratio 

are handled easily in conventional methods (such as the ^ 3 ^ fm^ax* a t™ax/ k« 

^ 11 J « *u j\ J f 16:9, the lower range of DRAM and VRAM will be 

"3 :2-pull-down method), and therefore the operator control L * ron^onco^uu-u 

f *u * • 1 ui *u ^^f^^i^ sufficient, but for a frame size of 2048x1152, the higher 

of the source material enables the user to utilize matenals oV.t^*^, jt^t^a^*- -jt 

. . . ^ t DAT range of DRAM and VRAM is required. In general, the 

onginatmg from conventional or widescreen PAL format . . «- • * ^ 1 « u* « 

^ J J ^t- 1 • *u 1* 1280x720 size is sufficient for conventional multi-sync 

sources for editmg and production, then replaying the result- ^^^^^ f^vj ^u.^ ^iai±l^l^u^ l^ji y.^ ^ ^L^^ 

4. f « • *^ ^'^u^^Z^^^A^^A 10 computer display screens up to 20 mches, and the 2048x 

mg program at 24 fps for conversion to either standard or ^ ^ . . . ^ ^ ^ , „ „ 

wLscreenNTSC output materials, or even to HDTV for- 1152 size is appropnate for conventional multi-sync conj- 

mat materials, all at 30 fps. by performing the "3:2-puU- P"f ^^P^^^ '^^J^' mches. Aiialog video outputs 

down" ocess f J' & *- 244 are available for these vanous display units. Usmg this 

own process. system, various formats may be displayed, including (for 25 

In these appUcations, the presence of the storage means ^^^^^^ speeding up 24 fps signals) 768x576 PAL/ 

allows the viewer to control the presentation of a program, SECAM, 1024x576 wide-screen, and 2048x1152 HDTV, 

utilizing a user interface 420 to control the playback delay ^^^^ 3Q ^^^^^ utilizing the well-known "3:2 

and other characteristics of the signal whUe it is being stored puU_down" technique, and for 29.97 fps, shown by a sUght 

or thereafter. In practice, a wide range of alternatives for glow-down in 30 fps signals) 640x480 NTSC and 854x480 

input frame rates and ou5)ut frame rate conversions are wide-screen, and 1280x720 USA and 1920x1080 NHK 

made available through this system, by selecting the most ^j^p^^ jjj^^y ^^^^^ monitors will synchro- 

^propriate of the various methods for altenng the frame ^^^^e to a 30 fps signal, possibly requiring that the color 

rate of a signal descnbed herem. subcanier frequency be adjusted, many PAL and SECAM 

FIG. 5 shows the inter-relationship of the various film and monitors will not accept a 24 fjps signal. In this case, more 

video formats compatible with the invention, though not sophisticated frame-rate conversion techniques, such as 

intended to be inclusive of all possible implementations. ttiose described herein above, may be required for viewing 

In-typical operations, the multi-format audio/video produc- Hve broadcasts, since the 24 ^s input signal rate cannot keep 

tion system 162 would receive film-based elements 160 and pace with the 25 fps display rate. However, in practice it is 

combine them with locally produced materials afready in the anticipated that future television sets will incorporate 
preferred internal format of 24 frames-per- second. In ^ "multi-sync" designs that eliminate this potential problem 

practice, materials may be converted from any other format appreciated by the skilled practitioner of the art 

including video at any frame rate or standard. After the jj^^t most of the highest quaUty program material has been 

production effects have been performed, the output signals originated on 24 fps 35-mm film, and therefore conversions 

may be configured for any use required, including, but not ^j^^t rely on reconstituting the signal material from 25 fps or 

limited to, HDTV at 30 fps shown as 164, NTSQwidescreen 39 fpg materials into 24 fps material do not entaU any loss 

at 30 fps shown as 166, PAL-SECAM/widescreen at 25 fps ^f data or program material. In addition, signals that have 

shown as 170, or HDTV at 25 fps shown as 172. In addition, ij^en interfaced from a lower or equivalent frame rate source 

output signals at 24 fps are available for use in a film- signal ^ny of the currently available means (24 fps to 25 

recording unit 168. fps via speed-up; 24 fps to 30 fps via *3:2-pull-down") may 

FIG. 6 shows an implementation involving one possible 50 be de-interlaced and reconstituted as progressive-scan 

choice for image sizes, aspect ratios, and frame rates to frames without introducing any signal artifacts, provided 

provide a universal television production system As shown, that the original frames are recreated from properly matched 

signals are provided from any of several sources, including fields. These techniques are summarized in FIG. 7. 

conventional broadcast signals 210, satellite receivers 212, piG. 8 shows one possible implementation of a universal 
and interfaces to a high bandwidth data network 214. These 55 playback device, in accordance with the invention. By way 

signals would be provided to the digital tuner 218 and an of example, a DVD-type video disc 802 is rotatably driven 

appropriate adapter unit 220 for the data network or "infor- by motor 804 under control of speed-control unit 806. One 

mation superhighway" before being supplied to the decom- or more laser read- or read/write-heads 808 are positioned 

pression processor 222. The processor 222 provides any by position control unit 810. Both the speed control unit and 
necessary data de-compression and signal conditioning for ^ the position control unit are directed by the overall system 

the various signal sources, and preferably is implemented as controller 812, at the direction of the user interface 814. It 

a plug-in circuit board for a general-purpose computer, should be noted that the number and configuration of read-or 

though the digital tuner 218 and the adapter 220 optionally read/write-heads will be determined by the choice of the 

may be included as part of the existing hardware. techniques employed in the various embodiments disclosed 

The output of processor 222 is provided to the internal 65 herein above. The signals recovered from the laser heads is 

data bus 226. The system microprocessor 228 controls the delivered to signal processor unit 820, and the data stream 

data bus, and is provided with 16 to 64 MB of RAM 230 and is split into an audio data stream (supplied to audio processor 
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unit 822) and a video data stream (supplied to video graphics replay the video information of the disc 802 at this higher 

processor unit 830). frame rate. The controller will configure the speed control 

During the audio recovery process, the alteration of the unit 806 (if necessary) to drive the motor 804 at a greater 

playback frame rate (for example, from 24 fps to 25 fps, rotational speed to sustain the increased data rate associated 

accomplished by speed control adjustment) may suggest the 5 with the higher frame rate. The audio processor 822, if so 

need for pitch-correction of the audio material. This equipped, will be configured to correct for the change in 

procedure, if desired, may be implemented either as part of pitch associated with the higher frame rate, and the Graphics 

the audio processor 822, or within a separate, external unit processor will be configured to provide all output signals at 

(not shown), as offered by a number of suppliers, such as jj^g 25 fps frame rate. 

Lexicon. ^ ^ As yet another alternative, materials produced at 25 fps 
The videojkta stream may undergo a number of modi- ^^^^^^ disc-based mass storage means of this 
fications witfun the graphics processor, shown generaUy at conventional standard or 
830. depending on ttie desired final output format. Assuimng ..^ r » • i it»-i- • .u i j 
that the ou5)ut desired is KTSC or some other form of wides^een PAL format signals. Utihzing the slow-down 
wide-screen or HEnTV signal output at a nominal frame rate , "method, these signals are readily converted to 24 fjps frame 
of 30 fps. a signal sourced from the disc at 24 fps would "te. from which conversion to various 30 fps formats is 
undergo a "3:2-pull-down" modification as part of the con- implemented, as disclosed herem above. This feature has 
version process (as explained herein above); if the signal as significance in the commercial development of HDTV, as 
sourced from the disk is based on 25 fps. then it would the ability to utilize more-or-less conventional PAL format 
undergo an preliminary slowdown to 24 fps before the equipment greatly facilitates the economical production and 
"3:2-pull-down" processing is applied. It should be noted 20 origination of materials intended for HDTV markets, 
that the 0.1% difference between 30 ^s and 29.97 fps only n ^ill be appreciated that a wide range of output frame 
requires tiiebufifering of 173 frames of video over tiie course j^tej may be made available through combination of the 
of a 120-minute program, and at a data rate of 8.1 MB/sec. techniques of speed-up. slow-down. "3-2-pull-down." and 
this corresponds to approxmatdy 57 MB of storage(fQr ^^jj^^,. ^^^^^ fleld-reairangement techniques as disclosed 
SUndardAvidescreen) or 115 MB of storage (for HDTV). 25 ^g^^jj^ ^^ove with respect to FIG. 4. and fliese various 
which readdy may-be implemented m seimconductor-based ^^^^inations and approaches should be considered to be 
memory. In any event a signal suppbed to the graphics ^^^^ ^^^^ invention. In addition, tiiese tech- 
processor at a nomina^ 24 fys smiultaneously may be output ^ ^^^^ ^.^^^ ^^^^^ ^^^^ ^^^^^ 

""■^ 1° trln ^fJ^'^n? T^^ q?* h ^/ which perform image manipulations such as line-doubUng. 

wift both OTSC and NTSC^w.des^(Ae^ 30 ^i^^^Ling, etc.. such that the display device will 

Wid^creen Video Interface 832) and HDTV (HDTV Video ^ ^^^^ ^ ^ ^^^^^ 

toterface 834). m accordance witii die invention as desOT^ J ^^^^ in^easing the actual data/ 

herem above. As djsclosed above an optional Film Output J^^^^/J^_ Qne example would be to process the 24 

Video Interface 836 may be included, with distal video internal format to convert it into a 48 fps 

outputs for a film recorder. Ov^all. Ae ou^uU for the 35 signalizing field-doubling techniques such as deinterlacing 

Graphics processor 830 paraUel those of tiie Mu^ti-Forma^ j.^^ 1 

AudioA^deo Production System as shown m FIG. 5 and ^ ^ u - 7 ^ « « a^.,ui^a « 

. ^ xjj... i: • i.t- store techmques to provide a frame-doubled output at a rate 
disclosed herem above, to addition, for signak to be output ^^^^ display-related improvements, in 
m a format havmg a different aspect ratio than ftat of-tiie ^^^^J^^^^ Z instant invention, should also be con- 
source signal. It may be necessary to perform a -pan/scan 40 ^.^^^ ^ „f ^^^^^^^ ^^1^,^ 
fimction in order to assure that the center of action in the herein 

source program material is presented witiiin the scopes "^^^i^ described the invention. I claim: 

output frame. This fiinction may be implemented withm the 1. a nfulti-format audio/video production system adapted 

graphics Focessor by utihzmg a tracking signal assoa- ^.^ ^ ^^^^ co^rising: 

ated with the source program matenal, for example, as part 45 . . . \ . ^ , 

of the data stream for each frame, or, alternatively, through ^ ^"f ^^^^^^ ^ ''^"f representative of an audio^ 

a Usting identifying changes that should be appHed during video program m one of a plurality of display formats; 

the presentation of the source material. Where no 'tracking" high-capacity video storage means including an asynchro- 

information is available, the image frame would be trimmed ^^us program recording and reproducing capability; 

along the top and bottom, or the sides, as necessary in order 50 ^ operator control; and 

to fit the aspect ratio of the source material to the aspect ratio a graphics processor in communication with the input, the 

of the output frame. This latter technique is explained herein high-capacity video storage means, and the operator 

above, with reference to FIGS. lA-lD. In addition, die control, enabling a user to perform the following fiinc- 

program material may include security information, such as tions: 

regional or geographical information directed towards con- 55 (a) convert the display format of the audio/video pro- 
trolling the viewing of the program material within certain gram received through the input into an intermediate 
marketing areas or identifiable classes of equipment (such as production format, 

hardware sold only in the United States or in the German (b) perform a frame-rate conversion of the audio/video 

market). This information, as has been disclosed for use with program received through the input means using the 

other disc- and tape-based systems, often relates to issues 60 asynchronous recording and reproducing capability 

such as legal licensing agreements for software materials; it associated with the high-capacity video storage 

may be processed in a way similar to the detection and means, and 

application of the "pan/scan" tracking signal, and the signal (c) output a p-ogram having a display format or frame 

processor 820, under the direction of controller 812 may act rate different than that of the audio/video program 

to enforce these restrictions. 65 received through the input. 

Alternatively, if output at 25 fps is desired, it is a simple 2. The multi-format audio/video production system of 

matter to configure the various components of this system to claim 1, wherein the graphics processor is operative to 
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output a program in a standard television format regardless asynchronous prqgram.recording and reproducing capa- 

of the display format of the input program. bilities to provide a program in an output format having 

3. The multi-format audio/video production system of a frame rate greater than 24 per second. 

claim 1, wherein the graphics processor is operative to 15. The multi-format audio/video production system of 

output a program in a widescreen format regardless of the 5 claim 14, wherein the means to convert the production 

display format of the input program. format into one or more of the output formats further 

4. The multi-format audio/video production system of includes interpolation means to expand the number of pixels 
claim 1, wherein the graphics processor is operative to associated with the production format. 

output a program in an enhanced-definition format regard- 16. The multi-format audio/video production system of 

less of the display format of the input program. lo claim 14, wherein the asynchronous program recording and 

5. The multi-format audio/video production system of reproducing capabilities are used to increase the frame rate 
claim 4, wherein the enhanced-definition format is an HDTV from the 24 fps production format frame rate to a 25 fps 
format. output frame rate. 

6. The multi-format audio/video production system of 17. The method of claim 16, wherein the step of manipu- 
claim 1, wherein the graphics processor is operative to 15 lating the video program in the production format further 
output a program in a film-compatible format regardless of includes the step of performing an interpolation operation on 
the display format of the input program. a received so as to expand the number of pixels associated 

7. The multi-format audio/video production system of with the production format as compared to the input format, 
claim 1, wherein the graphics processor is further operative 18. The method of claim 16, wherein the step of manipu- 
to perform a pan/scan operation with respect to the program 20 lating the video program in the production format further 
received through the input. includes the step of performing an interpolation operation on 

8. The multi-format audio/video production system of a received so as to reduce the number of pixels associated 
claim 1, wherein the graphics processor is further operative with the production format as compared to the input format, 
to perform an interpolation operation with respect to the 19. The method of claim 16, wherein the step of manipu- 
program received through the input so as to expand the 25 lating the video program in the production format includes 
number of pixels associated with the production format as the step of panning and scanning the vision center of the 
compared to the input display format displayed progranL 

9. The multi-format audio/video production system of 20. The method of claim 16, wherein the step of manipu- 
claim 1, wherein the graphics processor is further operative lating the video program in the production format includes 
to perform an interpolation operation with respect to the 30 the step of providing predetermined critma used to restrict 
program received through the input so as to reduce the the viewing of the program. 

number of pixels associated with the production format as 21. In an enhanced personal computer having a color 

compared to the input display format. monitor, the method of producing a video program, com- 

10. The imilti-format audio/video production system of prising the steps of: 

claim 1, wherein the high-capacity video storage means 35 receiving an input video program; 

includes sufficient capacity to store at least 120 minutes of converting the input video program into a production 

program material to perform the frame-rate conversion. ^^^^ . ^ predetermined frame rate and image 

11. The multi-format audio/video production system of dimension in pixels; 

claim 1, including high-c^adty video storage means in the ... . . 

form of a removable medium. 40 P^ovidmg a high-capacity video storage means equipped 

12. The multi-format audio/video production system of asynchronous program recordmg and repro- 
claim 1, furtiier including means for performing a data capability to perform a frame-rate conversion; 
compression operation on a program prior to storing the manipulating the video program in tiie production format 
program in tiie high-capacity video storage means. "sing the high-capacity video storage means on a 

13. The multi-format audio/video system of claim 1, 45 selective basis to ou^ut an edited version of the 
wherein tiie intermediate production format is based upon a program having a desired frame rate and image dimen- 
frame rate of 24 frames per second. sions in pixels which may be different from tiiose of the 

14. A multi-format audio/video production system form- production format. 

ing part of a general-purpose computer platform having a 22. The method of claim 21, further including the step of 

user input and a color display, the system con^rising: 50 interpolating tiie video program in tiie production format to 

means to receive an input video program in one of a ^"^"^ ^ ^^'^^ ^^^^^^^ P^^f ^ ^^^^""^ P^^* 

plurality of input formats; ^^^^er than that of the production fonnat. 

. ,^ 23. The method of claim 21, further includmg tiie step of 

high-capaaty video storage means; controlling pan/scan operations relative to tiie received input 

means to convert the input program into a 24 frames-per- video program- 
second (fjps) production format, if necessary, for stor- 24. The metiiod of claim 21, wherein tiie high-capacity 
age within the high-capacity video storage means and video storage means includes sufficient capacity to store at 
for review on tiie color display; least 120 minutes of program material. 

means to convert the production format into one or more 25. The method of claim 21, further including the step of 

of the following output formats, either directiy from the go providing a removable high-capacity video storage medium, 

input receiving means or from the storage means: 26. The method of claim 21, further including the step of 

NTSC at 30 fjps, data compressing the video program in the production 

PAL/SECAM at 25 fps, format. 

HDTV at 25 fps, 27. The method of claim 21, wherein the predetermined 

HDTV at 30 fps, 65 frame rate is 24 frames per second, 
film-compatible video at 24 ^s, and 

film-compatible video at 30 fjps; and ***** 



